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IN THE CLAIMS 
What is claimed is: 

1 . (Currently amended) A method of automated graphics generation in response to a user 
request comprising: 

determining a measure of similarity between the user request and one or more stored graphics 
graphical examples to measure whether the one or more stored graphical examples are adequate for 
creating one or more new graphical illustrations in accordance with the user request ; 

systematically decomposing the user request into sub-requests and the one or more stored 
graphical examples into graphical fragments in accordance with at least one of syntactic, semantic 
and pragmatic characteristics of the one or more graphical examples, if the user request and the one 
or more stored graphical examples are inadequately similar: 

searching for at least one of at least one matching graphical example and at least one 
graphical fragment among the one or more graphical examples for the user request: and 

obtaining at l e a s t on e s tor e d graphics exampl e bas e d on th e similarity m e asur e ; and 

composing cr e ating graphics the one or more new graphical illustrations from at least one of 
the at least one obtain e d graphic s graphical example and the at least one graphical fragment, using a 
pattern-based composition; 

wherein the determining, decomposing, searching and composing steps utilize a cooperative 
critiquing technique between a user and a system for automated graphics generation . 

2. (Currently amended) The method of claim 1 , wherein the step of determining a measure of 
similarity furth e r comprising comprises the step of : 

determining one or more adequacy criteria to measure whether the one or more stored 
graphical examples are adequate. 

d e t e rmining wh e th e r th e at l e ast on e obtain e d graphic s e xample ean - bousod for synth e sizing 
g raphic s- it> accordanc e with th e us e r requ e st; 

cr e ating graphics wh e n th e at l e ast on e obtain e d - graphics o - xampl e- oan-b e us e d for 
synth es izing graphie s -m-aceordano e with th e us e r r e qu e st; 



2 



Attorney Docket No. YOR92QQ40Q09US1 

d ecomposing the user r e qu e st into a sot of sub r e qu e sts wh e n at loast one obtained graphics 
e xampl e cannot be us e d for synthesizing graphics in accordanc e with th e us e r roqu e ot; and 
repeating tho - graphics generation m e thod using tho oot - of sub r e qu e st s . 

3 . (Currently amended) The method of claim 2, wherein determining whether the at least one 
obtain e d graphics graphical example is adequate can bo used for synth e sizing graphics comprises the 
steps of : 

determining whether oach graphics exampl e produc e s a match for data nodes in th e us e r 

determining whether important data is better represented in the graphics than less important 
data; and 

determining whether every data loaf nodo instance in the user request has acquired a visual 
candidate so that graphics can b e are capable of being synthesized ; and 

determining whether the one or more graphical examples can be instantiated using data in the 
user request . 

4. (Canceled) 

5. (Currently amended) The method of claim I 4, wherein the step of systematically 
decomposing at least one graphics graphical example comprises the steps of: e xtracting independ e nt 
visual structur e s- 
extracting independent visual structures; 

removing decorations; 

extracting leaf nodes to form a visual dictionary; and 
dividing bv data relations. 
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6. (Currently amended) The method of claim \ 4, wherein decomposing at least one graphics 
graphical example comprises removing d e corations using user-provided decomposition instructions 
that are at least one of provided by the user interactively during runtime or pre-stored in the system . 

7. (Canceled) 

8. (Original) The method of claim I 4, wherein the step of systematically decomposing at 
least one graphics graphical example comprises the steps of: dividing by - data r e lations. 

decomposing the user request based on data relations: 
decomposing a user request based on data groupings; 
decomposing a user request based on tasks and subtasks; and 

dynamically extracting fragments that failed to obtain a match during a case-based retrieval 
process. 

9. (Canceled) 

10. (Original) The method of claim 1, further comprising providing user feedback while 
computing similarity measurements. 

11. (Original) The method of claim 1, further comprising providing user feedback while 
creating graphics. 

12. (Currently amended) The method of claim 1, wherein obtaining at least one stored 
graphics graphical example comprises: 

arranging stored graphics graphical examples into hierarchical clusters according to each 
computed similarity measurement; 

searching a cluster at a highest hierarchical level most likely to contain a top-matched 
graphics graphical example having the greatest similarity measurement to the user request; 
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determining a measure of similarity between the user request and each g raphics graphical 

example within the searched cluster; and 

outputting at least one graphics graphical example of the searched cluster having the greatest 

similarity measurement. 

13. (Currently amended) The method of claim 12, further comprising: 
determining whether the searched cluster has no clusters inside it; and 

repeating the method of obtaining at least one stored graphics graphical example with clusters 
at a highest hierarchical level inside the searched cluster, if there are clusters inside the searched 
cluster, until a cluster having no clusters inside it is found. 

14. (Currently amended) The method of claim 12, wherein searching a cluster comprises: 
selecting a representative graphics graphical example from each cluster at the highest 

hierarchical level using an approximation; and 

selecting the cluster having the representative graphics graphical example with the greatest 
similarity measurement to the user request. 

15. (Currently amended) The method of claim 14, wherein the approximation uses meta 
properties of the stored graphics graphical examples. 

16. (Currently amended) The method of claim 1 , wherein creating graphics from at least one 
obtained graphics graphical example comprises: 

extracting at least one composition pattern from the database; 
generalizing the at least one composition pattern; 

determining whether at least one new composition is valid using at least one generalized 
composition pattern; and 

selecting the most probable valid composition. 
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17. (Original) The method of claim 16, further comprising: 
generalizing at least one negative composition pattern; and 

determining whether at least one new composition is invalid using at least one generalized 
negative composition pattern. 

18. (Original) The method of claim 1, wherein creating a new sketch comprises inferring 
visual decorations. 

19. (Currently amended) Apparatus for automatically generating graphics from a user request, 
the apparatus comprising: 

a memory; and 

at least one processor coupled to the memory and operative to: (i) determine a measure of 
similarity between the user request and one or more stored graphics graphical examples to measure 
whether the one or more stored graphical examples are adequate for creating one or more new 
graphical illustrations in accordance with the user request: firtsvstematicallv decompose the user 
request into sub-requests and the one or more stored graphical examples into graphical fragments in 
accordance with at least one of syntactic, semantic and pragmatic charac teristics of the one or more 
graphical examples, if the user request and the one or more store d graphical examples are 
inadequately similar: (Hi) search for at least one of at least one matching graphical e xample and at 
least one graphical fragment among the one or more graphic al examples for the user request; and (ft 
obtain at least one stored graphics example based on tho similarity measure; and £iv) compose 
creating graphic s the one or more new graphical illustrations from at least one of the at least one 
obtained graphics graphical example and the at least one graphical fragment, using a pattern-based 
composition: wherein the determining, decomposing, searching and composing steps utilize a 
cooperative critiquing technique between a user and a system f or automated graphics generation. 
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20. (Currently amended) The apparatus of claim 19, wherein the processor is further 
operative to: 

determine one or more adequacy criteria to measure whether the one or more stored graphical 
examples are adequate. 

d e t e rmin e wh e th e r th e at l e ast one obtain e d graphics e xampl e can b e us e d for synth e sizing 
graphics in accordanc e with th e us e r r e quest; 

cr e at e graphics wh e n th e at l e ast on e obtain e d graphios e xampl e can b e us e d for synth e sizing 
graphics in accordanc e with th e us e r r e qu e st; 

decompose-tfre user request into a sot of aub requests whon - at l e a s t on e obtain e d g rap h ks 
e xampl e cannot b e us e d for synth e sizing graphics in accordanc e with th e us e r r e qu e st; and 

r e p e at th e graphics g e n e ration m e thod using th e s e t of sub r e qu e sts, 

21. (Currently amended) The apparatus of claim 20, wherein the operation of determining 
whether the at least one obtained graphics graphical example can b e is adequate us e d for 

determining wheth e r e ach graphics e xampl e produces a match for data nod e s in th e us e r 

determining whether important data is better represented in the graphics than less important 
data; and 

determining whether every data l e af nod e instance in the user request has acquired a visual 
candidate so that graphics can b e are capable of being synthesized ; and 

determining whether the one or more graphical examples can be instantiated using data in the 
user request . 

22. (Canceled) 
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23. (Currently amended) The apparatus of claim 19 32-, wherein tho operation of 

systematically decomposing at least one graphics graphical example comprises: the operation of 
e x t racting ind e p e nd e nt visual structures. 

extracting independent visual structures; 
removing decorations; 

extracting leaf nodes to form a visual dictionary; and 
dividing by data relations. 

24. (Currently amended) The apparatus of claim 19 25, wherein the op e ration of 
decomposing at least one graphics graphical example comprises th e op e ration of r e moving 
d e corations using user-provided decomposition instructions that are at least one provided bvthe user 
interactively during runtime or pre-stored in the system . 



26. (Currently amended) The apparatus of claim 19 24, wherein the operation of 

decomposing at least one graphics graphical example comprises: th e op e ration of dividing by data 

d ecomposing the user request based on data relations; 
d ecomposing the user request based on data groupings; 
d ecomposing the user request based on tasks and subtasks; and 

d ynamically extracting fragments that failed to obtain a match during a case-b ased retrieval 
process. 

27. (Canceled) 

28. (Original) The apparatus of claim 19, wherein the processor is further operative to 
provide user feedback while computing similarity measurements. 



25. (Canceled) 
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29. (Original) The apparatus of claim 19, wherein the processor is further operative to 
provide user feedback while creating graphics. 

30. (Currently amended) The apparatus of claim 19, wherein the operation of obtaining at 
least one stored graphics graphical example comprises the operations of: 

arranging stored g raphics graphical examples into hierarchical clusters according to each 
computed similarity measurement; 

searching a cluster at a highest hierarchical level most likely to contain a top-matched 
graphics graphical example having the greatest similarity measurement to the user request; 

determining a measure of similarity between the user request and each graphics graphical 
example within the searched cluster; and 

outputting at least one graphte s graphical example of the searched cluster having the greatest 
similarity measurement. 

31. (Currently amended) The apparatus of claim 29, further comprising the operations of: 
determining whether the searched cluster has no clusters inside it; and 

repeating the method of obtaining at least one stored graphics graphical example with clusters 
at a highest hierarchical level inside the searched cluster, if there are clusters inside the searched 
cluster, until a cluster having no clusters inside it is found. 

32. (Currently amended) The apparatus of claim 29, wherein the operation of searching a 
cluster comprises the operations of: 

selecting a representative g raphics graphical example from each cluster at the highest 
hierarchical level using an approximation; and 

selecting the cluster having the representative graphics graphical example with the greatest 
similarity measurement to the user request. 
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33. (Currently amended) The apparatus of claim 32, wherein the approximation uses meta 
properties of the stored graphics graphical examples. 

34. (Currently amended) The apparatus of claim 19, wherein the operation of creating 
graphics from at least one obtained graphics) graphical example comprises the operations of: 

extracting at least one composition pattern from the database; 
generalizing the at least one composition pattern; 

determining whether at least one new composition is valid using at least one generalized 
composition pattern; and 

selecting the most probable valid composition. 

35. (Original) The apparatus of claim 34, further comprising the operations of: 
generalizing at least one negative composition pattern; and 

determining whether at least one new composition is invalid using at least one generalized 
negative composition pattern. 

36. (Currently amended) The apparatus of claim 19, wherein the operation of creating a new 
sketch comprises the operation of inferring visual decorations. 

37. (Currently amended) An article of manufacture for automatically generating graphics 
from a user request, comprising a machine readable medium containing one or more programs which 
when executed implements: 

determining a measure of similarity between the user request and one or more stored graphics 
graphical examples to measure whether the one or more stored graphical examples are adequate for 
creating one or more new graphical illustrations in accorda nce with the user request; 

systematically decomposing the user request into sub-requests and the one or more stored 
graphical examples into graphical fragments in accor dance with at least one of syntactic, semantic 
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and pragmatic characteristics of the one or more graphical examples, if the user request and the one 
or more stored graphical examples are inadequately similar; 

searching for at least one of at least one matching graphical example and at least one 
graphical fragment among the one or more graphical examples for the user request; and 

obtaining at least ono stored graphic s e xample bas e d on th e similarity m e asure; and 

composing cr e ating graphics the one or more new graphical illustrations from at least one of 
the at least one obtained graphics graphical example and the at least one graphical fragment, using a 
pattern-based composition; 

wherein the determining, decomposing, searching and composing steps utilize a cooperative 
critiquing technique between a user and a system for automated graphics generation . 
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